Variational Bayesian inference with Gaussian-mixture approximations
نویسندگان
چکیده
منابع مشابه
Concave Gaussian Variational Approximations for Inference in Large-Scale Bayesian Linear Models
Two popular approaches to forming bounds in approximate Bayesian inference are local variational methods and minimal KullbackLeibler divergence methods. For a large class of models we explicitly relate the two approaches, showing that the local variational method is equivalent to a weakened form of Kullback-Leibler Gaussian approximation. This gives a strong motivation to develop efficient meth...
متن کاملVariational approximations in Bayesian model selection for finite mixture distributions
Variational methods for model comparison have become popular in the neural computing/machine learning literature. In this paper we explore their application to the Bayesian analysis of mixtures of Gaussians. We also consider how the Deviance Information Criterion, or DIC, devised by Spiegelhalter et al. (2002), can be extended to these types of model by exploiting the use of variational approxi...
متن کاملUncertainty propagation using infinite mixture of Gaussian processes and variational Bayesian inference
Uncertainty propagation in flow through porous media problems is a challenging problem. This is due to the high-dimensionality of the random property fields, e.g. permeability and porosity, as well as the computational complexity of the models that are involved. The usual approach is to construct a surrogate response surface and then use it instead of the expensive model to carry out the uncert...
متن کاملAn Introduction to Bayesian Inference Via Variational Approximations∗
Markov Chain Monte Carlo (MCMC) methods have facilitated an explosion of interest in Bayesian methods. MCMC is an incredibly useful and important tool, but can face difficulties when used to estimate complex posteriors or models applied to large data sets. In this paper I show how a recently developed tool in computer science for fitting Bayesian models, variational approximations, can be used ...
متن کاملAn Introduction to Bayesian Inference Via Variational Approximations: Supplemental Notes
1.1 The Tractability-Fit Tradeoff in Variational Approximations The goal of a variational approximation is to approximate a posterior, p(β|Y ) by making an approximating distribution, q(β), as close as possible to the true posterior (Bishop, 2006). We search over the space of approximating distributions in order to find the particular distribution with the minimum KL-divergence with the actual ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronic Journal of Statistics
سال: 2014
ISSN: 1935-7524
DOI: 10.1214/14-ejs887